I had the unique opportunity to be part of the team that developed the world's first social robot for the home, Jibo. While at Jibo Inc. I developed Jibo's skills as well as core features of his API such as the GUI framework and a system that helped enable remote control of Jibo via mobile apps.
GUI Framework
When I first began at Jibo there was not much in the way of an API when it came to the creating GUIs and other displays for Jibo's touch screens. I proposed and developed a framework that other skill developers could use within their skills, that streamlined GUI creation, asset loading, touch interfacing, as well as management of the page transitions that abided by the Design teams specifications.
These videos capture only Jibo's screen in order to clearly demonstrate the GUI framework's components and view management.
Robot Skills
I also worked on a number of Jibo's 'skills', which could be thought of an kind of focused experience for a specific task. Though it passed through a number of development hands I was ultimately responsible for the development and collaboration with design on the photo taking skill Snapshot and Photobooth, which was an interesting skill as it used the majority of Jibo's wide ranging HCI channels. I also developed and helped design Jibo's tutorial skill, the Yoga skill, and the Main Menu, as well as contributing to the design of the computer vision driven game Circuit Saver and Word of the Day.
Remote Control Support
The Be A Maker app was created by Everis, but was able to communicate commands to and get response from Jibo via the command system that I created on the robot. My team worked with the app makers to make sure that all of the controls required by the app were implemented on robot and working efficiently.